Search for: All records

In an era dominated by web-based intelligent customer services, the applications of Sentence Pair Matching are profoundly broad. Web agents, for example, automatically respond to customer queries by finding similar past questions, significantly reducing customer service expenses. While current large language models (LLMs) offer powerful text generation capabilities, they often struggle with opacity, potential text toxicity, and difficulty managing domain-specific and confidential business inquiries. Consequently, the widespread adoption of web-based intelligent customer services in real-world business still greatly relies on query-based interactions. In this paper, we introduce a series of model-agnostic techniques aimed at enhancing both the accuracy and interpretability of Chinese pairwise sentence-matching models. Our contributions include (1) An Edit-distance-weighted fine-tuning method, (2) A Bayesian Iterative Prediction algorithm, (3) A Lexical-based Dual Ranking Interpreter, and (4) A Bi-criteria Denoising strategy. Experimental results on the Large-scale Chinese Question Matching Corpus (LCQMC) with a disturbed test demonstrate that our fine-tuning and prediction methods can steadily improve matching accuracy, building on the current state-of-the-art models. Besides, our interpreter with denoising strategy markedly enhances token-level interpretation in rationality and loyalty. In both matching accuracy and interpretation, our approaches outperform classic methods and even LLMs. 

Power system equipment presents special signatures at the incipient stage of faults. As more renewables are integrated into the systems, these signatures are harder to detect. If faults are detected at an early stage, economical losses and power outages can be avoided in modern power grids. Many researchers and power engineers have proposed a series of signature-specific methods for one type of equipment's waveform abnormality. However, conventional methods are not designed to identify multiple types of incipient faults (IFs) signatures at the same time. Therefore, we develop a general-purpose IF detection method that detects waveform abnormality stemming from multiple types of devices. To avoid the computational burden of the general-purpose IF detection method, we embed the abnormality signatures into a vector and develop a pre-training model (PTM) for machine understanding. In the PTM, signal "words," "sentences," and "dictionaries" are designed and proposed. Through the comparison with a machine learning classifier and a simple probabilistic language model, the results show a superior detection performance and reveal that the training radius is highly related to the size of abnormal waveforms.